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HANDWRITTEN FILE NAMES 
RELATED APPLICATION DATA 

[01] This application is a continuation-in-part of U.S. Patent Appln. No. 10/291,214, filed 
November 10, 2002, entitled "Organization Of Handwritten Notes Using Handwritten 
Titles," and naming Michael S. Bernstein, Vikram Madan, Gregory H. Manto, 
Gerhard A. Schobbe, Shawna Swanson, Kurt A. Geisel, and Steven E. Weil as 
inventors. This prior application is entirely incorporated herein by reference. 



FIELD OF THE INVENTION 

[02] The present invention generally relates to systems, methods, and computer-readable 
media with computer-executable instructions stored thereon for providing handwritten 
file names and/or other electronic ink data for use by objects managed by a computer 
operating system and/or that are accessible by the operating system. 



BACKGROUND 

[03] Typical computer systems, especially computer systems using graphical user 
interfaces (GUIs), are optimized for accepting user input from one or more discrete 
input devices, such as a keyboard for entering text, and a pointing device, such as a 
mouse with one or more buttons, for operating the user interface. An example of such 
a GUI is the user interface for the Windows® computer operating system (available 
from Microsoft Corporation of Redmond, Washington). The ubiquitous keyboard and 
mouse interface provides for fast creation and modification of documents, 
spreadsheets, database fields, drawings, photos, and the like. 

[04] Recently, however, pen-based computing systems, such as tablet PCs and the like, 
have been increasing in popularity. In pen-based computing systems, user input is 
advantageously introduced using an electronic "pen" or stylus (e.g., akin to writing 
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with a pen or pencil on a piece of paper). Indeed, in at least some pen-based 
computing systems, all user input is capable of being entered and manipulated using 
an electronic pen input device, and the user interface is fully controllable using only 
the electronic pen. 

[05] Typically, with presently available pen-based computing systems, individual file 
names (and other information associated with a file or document) may be input in 
various ways, such as by using a keyboard (hard or soft) to type in the name or by 
entering the title as electronic ink data. When entered as electronic ink, however, the 
file name typically is immediately recognized and converted to machine-generated 
text (using handwriting recognition technology), because typical operating systems 
are not capable of reading and/or displaying electronic ink in all displays in which the 
file name may appear (such as in search result hit lists, list file display lists, recently 
used file display lists, etc.). Once recognized and converted, only the machine- 
generated text is displayed in the various objects managed by the operating system. 

[06] While the above systems are useful and desirable, some difficulties can arise. For 
example, users accustomed to entering data in electronic ink form may dislike using a 
hard or soft keyboard to enter the file name information (finding it slow or 
inconvenient). With respect to file names and/or other information input as electronic 
ink and then converted to machine-generated text, conventional handwriting 
recognizers do not always do a good job recognizing handwriting, particularly for file 
names, which do not necessarily follow a well-established dictionary or conventional 
grammar rules. 

[07] Accordingly, there is a need in the art for systems and methods that allow input and 
display of file names and/or other information in electronic ink format in objects 
managed by a computer operating system, while still providing searching and other 
capabilities available with machine-generated file names used by conventional 
operating systems. 
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SUMMARY 

[08] Aspects of the present invention relate to systems and methods that allow users to 
receive, save, access, render, and/or display handwritten information in objects 
managed by an operating system and/or that are accessible by the operating system. 
For example, systems and methods according to at least some examples of the 
invention allow the operating system to receive, save, access, render, and/or display 
handwritten information (e.g., in the form of electronic ink) for use as file names (e.g., 
for files, documents, graphics, etc. saved on or accessible by the computer system); 
author identifiers; keywords or comments associated with a file, document, or object; 
and the like. At least some examples of this invention include systems and methods 
that: (a) receive electronic ink data associated with a file or document saved on or 
accessible by a computer (e.g., via an input system); (b) store the electronic ink data 
(e.g., on any suitable storage system, for example, on computer-readable media 
accessible by the computer system); and (c) provide operating system access to at 
least some of the stored electronic ink data (e.g., via an ink access system that 
accesses the storage system). Then, whenever the file name (or other information) is 
displayed in an object managed by the operating system, it will be displayed in 
electronic ink format. Additional aspects of the invention relate to computer-readable 
media including computer-executable instructions stored thereon for performing 
various methods and/or operating various systems, including systems and methods 
like those described above. 



BRIEF DESCRIPTION OF THE DRAWINGS 

[09] The above and other objects, features, and advantages of the present invention will be 
readily apparent and fully understood from the following detailed description, taken in 
connection with the appended drawings, in which: 

[10] Figure 1 illustrates a schematic diagram of a general-purpose digital computing 
environment in which certain aspects of the present invention may be implemented; 
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[11] Figure 2 illustrates a pen-based personal computing (PC) environment in which 
certain aspects of the present invention may be implemented; 



[12] Figure 3 illustrates an example file list display screen managed by an operating 
system that displays at least certain information in electronic ink form in accordance 
with an example of the invention; 

[13] Figure 4 illustrates an example file preview display screen managed by an operating 
system that displays at least certain information in electronic ink form in accordance 
with an example of the invention; 

[14] Figure 5 illustrates an example display screen managed by an operating system that 
both displays a file list (or portion thereof) and allows the user to view preview 
information associated with a file in accordance with an example of the invention; 

[15] Figures 6A and 6B illustrate an example "save as" or "save" operation managed by an 
operating system in accordance with an example of the invention; 

[16] Figures 7 A through 7C illustrate an example file "rename" operation managed by an 
operating system in accordance with an example of the invention; 

[17] Figures 8 A through 8C illustrate an example "add ink file name" operation managed 
by an operating system in accordance with an example of the invention; 

[18] Figure 9 illustrates examples of other places where file names and/or other 
information in electronic ink form may appear in accordance with various examples 
of this invention; 

[19] Figure 10 illustrates an example of fading out the display of a file name that may be 
used in at least some examples of the invention; and 

[20] Figure 1 1 illustrates an example architecture that may be used in providing systems 
and methods according to at least some examples of this invention. 
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DETAILED DESCRIPTION 



[21] As described above, aspects of the present invention relate to systems, methods, and 
computer-readable media for receiving, saving, accessing, rendering, and/or 
displaying electronic ink data and/or other information in objects managed by an 
operating system. The following description is divided into sub-sections to assist the 
reader. The sub-sections include: Terms; General Description of Various Aspects of 
the Invention; Example Hardware; Example Systems, Methods, and Computer- 
Readable Media According to the Invention; and Conclusion. 

I. TERMS 

[22] The following terms are used in this specification and, unless otherwise specified or 
clear from the context, the terms have the meanings provided below: 

[23] "Operating system" - The low-level software that handles the interface to peripheral 
hardware, schedules tasks, allocates storage, presents a default interface to the user 
when no application program is running, etc. An operating system may be split into a 
kernel that is always present and various system programs that use facilities provided 
by the kernel to perform various tasks, such as higher-level house-keeping tasks, 
acting as servers in a client-server relationship, and the like. In at least some 
examples, an operating system may include a graphical user interface. Example 
operating systems include, but are not limited to: MS-DOS® (available from 
Microsoft Corporation of Redmond, Washington); Macintosh® (available from Apple 
Computer, Inc. of Cupertino, California); Windows® (available from Microsoft 
Corporation of Redmond, Washington); NetWare® (available from Novell, Inc. of 
Orem, Utah); and OS/2® (available from IBM Corporation of Armonk, New York). 

[24] "Application program" - Typically a complete, self-contained program that performs 
a specific function directly for the user. This is in contrast to system software, such as 
the operating system, which support application programs. Various types of 
application programs are known in the art, such as spreadsheet programs, word 
processing programs, email management programs, scheduling or calendar programs, 
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drawing programs, painting programs, document or file management programs, 
internet access and browsing programs, etc. 

[25] "Object managed by the operating system" - Any element, item, interface, dialog box, 
or other object that is produced, maintained, accessed, or otherwise processed by an 
operating system. 

[26] "Render" or "Rendered" or "Rendering" - The process of determining how 
information (including text, graphics, and/or electronic ink) is to be displayed, 
whether on a screen, printed, or output in some other manner. 

[27] "Computer-readable medium" means any available media that can be accessed by a 
user on a computer system. By way of example, and not limitation, "computer- 
readable media" may include computer storage media and communication media. 
"Computer storage media" includes volatile and nonvolatile, removable and non- 
removable media implemented in any method or technology for storage of 
information, such as computer-readable instructions, data structures, program 
modules or other data. "Computer storage media" includes, but is not limited to, 
RAM, ROM, EEPROM, flash memory or other memory technology; CD-ROM, 
digital versatile disks (DVD) or other optical storage devices; magnetic cassettes, 
magnetic tape, magnetic disk storage or other magnetic storage devices; or any other 
medium that can be used to store the desired information and that can be accessed by 
a computer. "Communication media" typically embodies computer-readable 
instructions, data structures, program modules or other data in a modulated data 
signal, such as a carrier wave or other transport mechanism, and includes any 
information delivery media. The term "modulated data signal" means a signal that 
has one or more of its characteristics set or changed in such a manner as to encode 
information in the signal. By way of example, and not limitation, communication 
media includes wired media, such as a wired network or direct-wired connection, and 
wireless media, such as acoustic, RF, infrared and other wireless media. 
Combinations of any of the above should also be included within the scope of 
"computer-readable media." 
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II. GENERAL DESCRIPTION OF VARIOUS ASPECTS OF THE 
INVENTION 

[28] Aspects of the present invention relate to systems and methods that allow users to 
receive, save, access, render, and/or display handwritten information in objects 
managed by an operating system and/or that are accessible by the operating system. 
For example, systems and methods according to at least some examples of the 
invention allow the operating system to receive, save, access, render, and/or display 
handwritten information (e.g., in the form of electronic ink) for use as file names (e.g., 
for files, documents, graphics, etc. saved on or accessible by the computer system); 
author identifiers; keywords or comments associated with a file, document, etc.; and 
the like. 

[29] Aspects of this invention relate to computer systems and methods for receiving, 
saving, accessing, rendering, and/or displaying handwritten information in objects 
managed by an operating system of the computer. Such systems and methods may 
include, for example: (a) receiving electronic ink data associated with a file or 
document saved on or accessible by a computer (e.g., via an input system); (b) storing 
the electronic ink data (e.g., on any suitable storage system, for example, on 
computer-readable media accessible by the computer system); and (c) providing 
operating system access to at least some of the stored electronic ink data (e.g., via an 
ink access system that accesses the storage system). Computer systems and methods 
according to aspects of the invention further may render or display the electronic ink 
data as electronic ink. 

[30] The electronic ink data may include any suitable information associated with the file, 
document, etc., such as an electronic ink title for the file, document, etc. (e.g., a 
document title); an electronic ink author identification for the file, document, etc. 
(e.g., the document's creator, editor, etc.); an electronic ink keyword associated with 
the file, document, etc. (which also may include associated machine-readable text); 
and an electronic ink comment associated with the file, document, etc. (which also 
may include associated machine-readable text). This electronic ink data may be 
rendered or displayed in objects managed by the operating system at any suitable time 
without departing from the invention. For example, an electronic ink title or other 
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electronic ink data may be rendered as part of a file list operation and/or at any other 
time that the title is displayed in objects managed by the computer operating system 
(e.g., as part of a file preview operation, in a title bar, in an application bar, in a 
"recently used" file listing, etc.). 

[31] Additionally, the electronic ink data may be input into systems and methods 
according to the invention at any suitable time and in any suitable manner without 
departing from the invention. For example, an electronic ink title or other electronic 
ink data may be input into the systems and methods as part of a "save" operation 
(which includes "save as" operations); as part of a "file name change" operation; as 
part of an "edit profile" or "create profile" operation; as part of an "add ink name" or 
"add ink data" operation; and the like. 

[32] Additional aspects of this invention relate to controlling data transfer and interaction 
between an application program and an operating system to enable the display of 
handwritten electronic ink titles and/or other information. Such aspects of the 
invention may include, for example: (a) sending data (e.g., as a request or flag) from 
an application program to an operating system for activation of an electronic ink entry 
region when storing information associated with a document or file on the application 
program; (b) receiving the data in the operating system; and (c) providing a user 
interface including the electronic ink entry region to the application program when the 
application program seeks to store information associated with a document or file. In 
at least some examples of these aspects of the invention, the data may be sent from 
the application program to the operating system as part of a call requesting return of 
the user interface and activation of a process for storing data associated with a 
document or file present on the application program. As an even more specific 
example, the data may be sent from the application program to the operating system 
as a flag set in a call parameter sent by the application program when it calls to the 
operating system for a common save dialog box for saving data associated with a 
document or file. 

[33] Additional aspects of the invention relate to computer-readable media including 
computer-executable instructions stored thereon for performing various methods 
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and/or operating various systems, including systems and methods according to the 
invention like those described above. 

III. EXAMPLE HARDWARE 

[34] Fig. 1 illustrates a schematic diagram of a general-purpose digital computing 
environment that can be used to implement various aspects of the present invention. 
In Fig. 1, a computer 100 includes a processing unit 1 10, a system memory 120, and a 
system bus 130 that couples various system components including the system 
memory 120 to the processing unit 110. The system bus 130 may be any of several 
types of bus structures including a memory bus or memory controller, a peripheral 
bus, and a local bus using any of a variety of bus architectures. The system memory 
120 may include read only memory (ROM) 140 and random access memory (RAM) 
150. 

[35] A basic input/output system 160 (BIOS), which contains the basic routines that help 
to transfer information between elements within the computer 100, such as during 
start-up, is stored in the ROM 140. The computer 100 also may include a hard disk 
drive 1 70 for reading from and writing to a hard disk (not shown), a magnetic disk 
drive 180 for reading from or writing to a removable magnetic disk 190, and an 
optical disk drive 191 for reading from or writing to a removable optical disk 192, 
such as a CD ROM or other optical media. The hard disk drive 170, magnetic disk 
drive 180, and optical disk drive 191 are connected to the system bus 130 by a hard 
disk drive interface 192, a magnetic disk drive interface 193, and an optical disk drive 
interface 194, respectively. These drives and their associated computer-readable 
media provide nonvolatile storage of computer-readable instructions, data structures, 
program modules, and other data for the personal computer 100. It will be 
appreciated by those skilled in the art that other types of computer-readable media 
that can store data that is accessible by a computer, such as magnetic cassettes, flash 
memory cards, digital video disks, Bernoulli cartridges, random access memories 
(RAMs), read only memories (ROMs), and the like, may also be used in the example 
operating environment. 
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[36] A number of program modules can be stored on the hard disk drive 170, magnetic 
disk 190, optical disk 192, ROM 140, or RAM 150, including an operating system 
195, one or more application programs 196, other program modules 197, and program 
data 198. A user can enter commands and information into the computer 100 through 
input devices, such as a keyboard 101 and pointing device 102 (such as a mouse). 
Other input devices (not shown) may include a microphone, joystick, game pad, 
satellite dish, scanner, or the like. These and other input devices are often connected 
to the processing unit 110 through a serial port interface 106 that is coupled to the 
system bus 130, but they also may be connected by other interfaces, such as a parallel 
port, game port, or a universal serial bus (USB), and the like. Further still, these 
devices may be coupled directly to the system bus 130 via an appropriate interface 
(not shown). 

[37] A monitor 107 or other type of display device also may be connected to the system 
bus 130 via an interface, such as a video adapter 108. In addition to the monitor 107, 
personal computers typically include other peripheral output devices (not shown), 
such as speakers and printers. In one example, a pen digitizer 165 and accompanying 
pen or stylus 166 are provided in order to digitally capture freehand input (e.g, as 
electronic ink). Although a connection between the pen digitizer 165 and the serial 
port interface 106 is shown in Fig. 1, in practice, the pen digitizer 165 may be directly 
coupled to the processing unit 1 10, or it may be coupled to the processing unit 1 10 in 
any suitable manner, such as via a parallel port or another interface and the system 
bus 130 as is known in the art. Furthermore, although the digitizer 165 is shown apart 
from the monitor 107 in Fig. 1, the usable input area of the digitizer 165 may be co- 
extensive with the display area of the monitor 107. Further still, the digitizer 165 may 
be integrated in the monitor 107, or it may exist as a separate device overlaying or 
otherwise appended to the monitor 107. 

[38] The computer 100 can operate in a networked environment using logical connections 
to one or more remote computers, such as a remote computer 109. The remote 
computer 109 can be a server, a router, a network PC, a peer device or other common 
network node, and it typically includes many or all of the elements described above 
relative to the computer 100, although for simplicity, only a memory storage device 
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1 1 1 has been illustrated in Fig. 1. The logical connections depicted in Fig. 1 include a 
local area network (LAN) 112 and a wide area network (WAN) 113. Such 
networking environments are commonplace in offices, enterprise-wide computer 
networks, intranets, and the Internet, using both wired and wireless connections. 

[39] When used in a LAN networking environment, the computer 100 is connected to the 
local area network 112 through a network interface or adapter 114. When used in a 
WAN networking environment, the personal computer 100 typically includes a 
modem 1 15 or other means for establishing a communications link over the wide area 
network 113, such as the Internet. The modem 115, which may be internal or external 
to the computer 100, may be connected to the system bus 130 via the serial port 
interface 106. In a networked environment, program modules depicted relative to the 
personal computer 100, or portions thereof, may be stored in the remote memory 
storage device. 

[40] It will be appreciated that the network connections shown are examples and other 
techniques for establishing a communications link between the computers can be 
used. The existence of any of various well-known protocols such as TCP/IP, 
Ethernet, FTP, HTTP, UDP, and the like is presumed, and the system can be operated 
in a user-server configuration to permit a user to retrieve web pages from a web-based 
server. Any of various conventional web browsers can be used to display and 
manipulate data on web pages. 

[41] Although the Fig. 1 environment is one example of a suitable environment for 
operating systems and methods according to the invention, it will be understood that 
other computing environments also may be used. For example, one or more examples 
of the present invention may use an environment having fewer than all of the various 
aspects shown in Fig. 1 and described above, and these aspects may appear in various 
combinations and subcombinations that will be apparent to one of ordinary skill. 

[42] Fig. 2 illustrates a pen-based personal computer (PC) 201 that can be used in 
accordance with various aspects of the present invention. Any or all of the features, 
subsystems, and functions in the system of Fig. 1 can be included in the computer of 
Fig. 2. The pen-based personal computer system 201 includes a large display surface 
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202, e.g., a digitizing flat panel display, such as a liquid crystal display (LCD) screen, 
on which a plurality of windows 203 is displayed. Using stylus 204, a user can select, 
highlight, and write on the digitizing display area. Examples of suitable digitizing 
display panels include electromagnetic pen digitizers, such as pen digitizers available 
from Mutoh Co. (now known as FinePoint Innovations Co.) or Wacom Technology 
Co. Other types of pen digitizers, e.g., optical digitizers, may also be used. The pen- 
based computing system 201 interprets gestures made using stylus 204 in order to 
manipulate data, enter text, and execute conventional computer application tasks, such 
as creating, editing, and modifying spreadsheets, word processing programs, and the 
like. 

[43] The stylus 204 may be equipped with buttons or other features to augment its 
capabilities. In one example, a stylus 204 could be implemented as a "pencil" or 
"pen", in which one end constitutes a writing portion and the other end constitutes an 
"eraser" end, and which, when moved across the display, indicates portions of 
electronic ink on the display that are to be erased. Other types of input devices, such 
as a mouse, trackball, keyboard, or the like also could be used in the system of Fig. 2. 
Additionally, a user's own finger could be used for selecting or indicating portions of 
the displayed image on a touch-sensitive or proximity-sensitive display. 
Consequently, the term "user input device," as used herein, is intended to have a 
broad definition and encompasses many variations on well-known input devices. 

[44] In various examples, the system provides an ink platform as a set of COM 
(component object model) services that an application program can use to capture, 
manipulate, and store ink. The ink platform also may include a mark-up language 
including a language like the extensible markup language (XML). As still further 
examples, systems may use ".NET" or DCOM (distributed component object model) 
as additional implementations of the ink platform. Yet further implementations may 
be used including the Win32 programming model and the .Net programming model 
from Microsoft Corporation. These platforms are commercially available and known 
in the art. 



-12- 



Patent Application Atty. Docket No.: 003797.00675 

[45] In addition to use with full performance pen-based computing systems or "tablet PCs" 
(e.g., convertible laptops or "slate" type tablet PCs), aspects of this invention can be 
used in conjunction with other types of pen-based computing systems and/or other 
devices that accept and/or display data as electronic ink and/or accept and/or display 
electronic pen or stylus input, such as: hand-held or palm-top computing systems; 
personal digital assistants; pocket personal computers; mobile and cellular telephones, 
pagers, and other communication devices; watches; appliances; and any other devices 
or systems that include a monitor or other display device and/or a digitizer that 
presents printed or graphical information to users and/or allows input using an 
electronic pen or stylus. 

[46] The invention now will be described in conjunction with the remaining figures, which 
illustrate various examples of the invention and information to help explain the 
invention. The specific figures and information contained in this detailed description 
should not be construed as limiting the invention. 

IV. EXAMPLE SYSTEMS, METHODS, AND COMPUTER-READABLE 
MEDIA ACCORDING TO THE INVENTION 

[47] As described above, aspects of the present invention relate generally to systems and 
methods for receiving, saving, accessing, rendering, and/or displaying electronic ink 
data and information associated with documents, files, and the like saved on and/or 
accessible by a computer system. Fig. 3 generally illustrates an exemplary depiction 
of an object managed by a computer operating system (a computer display screen 
300) in which the operating system renders at least some information associated with 
various files or documents saved on and/or accessible by the system in electronic ink 
format. In one aspect of this invention, at least some file names and/or other 
information are displayed in objects managed by the computer's operating system as 
electronic ink information (e.g., as handwritten file names). As shown in Fig. 3, the 
file names for at least some of the files or documents created, authored, or saved by 
Authors A and B are displayed as electronic ink (e.g., the files named "My Resume," 
"Taxes," "Drawing B," "Chart B," "Flight Info," "Draft 1," and "Revised Draft," in 
the illustrated example). In the illustrated example, the display screen 300 is 
presented by the operating system in response to a "list files" type operation activated 
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by the user. Of course, any suitable event or other action may precipitate the "list 
files" operation and/or otherwise result in generation of a listing of files by the 
operating system, such as a file search operation, a keyword search operation, a 
request to see a listing of recently created or recently edited documents, etc. 

[48] Notably, systems and methods according to at least some examples of the present 
invention are not limited to displaying only file names in electronic ink. Other 
information associated with the file or document also may be displayed in electronic 
ink. For example, as illustrated in Fig. 3, the document's "author" also may be 
displayed in electronic ink format. In the illustrated example, "Author A" and 
"Author B" have chosen to have their names displayed by the operating system in 
electronic ink form, while "Author C" in this example has chosen to have his/her 
name displayed in machine-generated text. Other information also may be displayed 
by the operating system as handwritten text or in electronic ink format without 
departing from the invention, such as keywords or comments associated with a 
document or file, time and date stamp information, and the like. 

[49] Once a particular format has been chosen for a document name, author name, or other 
information (e.g., electronic ink format or machine-generated text), the information 
will be displayed by the operating system using the selected format in all instances 
and/or in all fields in which the information is displayed. For example, electronic ink 
representing the "author name" may be entered into the system a single time, and each 
time that author's name is to be displayed by the system, it could be displayed using 
that previously saved electronic ink information. Additionally and/or alternatively, if 
desired, a user or an application program may selectively indicate and/or change the 
format in which the information will appear, e.g., on a document-by-document basis, 
on a global basis, etc. As still another option or alternative, systems and methods 
according to at least some examples of the invention may include a feature or option 
for globally disabling the ink file name display in the entire operating system, e.g., for 
use by those who do not desire to see the ink titles or other ink information in the 
various listings or other objects managed by the operating system. 
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[50] Fig. 4 illustrates another example depiction of an object managed by a computer 
operating system (a computer display screen 400 in this example) in which the 
operating system renders at least some information associated with various files or 
documents saved on and/or accessible by the system in electronic ink format. In this 
example, the display screen 400 provides a file "view" or "preview" function. To 
arrive at the display screen 400 illustrated in Fig. 4, in this example, a user has 
selected a file name from a listing and activated a "view" or "preview" function (e.g., 
by "right-clicking" on the file name "Flight Info" 302 from the listing shown in Fig. 3 
and selecting the "view" (or "preview") option 304 from the list of available options). 
Of course, any suitable procedure or action for arriving at the display screen 400 of 
Fig. 4 may be used without departing from the invention. 

[51] As shown in Fig. 4, the file name (or document title "Flight Info") 402 appears in 
electronic ink format each place that it appears in the display 400 (as it also does in 
item 302 in Fig. 3). Additionally, as in Fig. 3, the "author name" associated with this 
document is displayed in the preview panel of Fig. 4 in electronic ink format (as 
shown at reference number 404). Additionally, in the illustrated example, electronic 
ink comments 406 have been provided and associated with this file. A separate panel 
408 in the display 400 allows the user to view (or preview) the actual content of the 
document without the need to open it. Of course, any suitable or desired information 
may be displayed the preview screen 400 without departing from the invention (such 
as file size, creation date, last edit date, edit history, last viewing, parties editing or 
viewing, etc.). Additionally, any suitable or desired functions may be accessible 
through the preview screen 400 without departing from the invention, including, for 
example, the various functions illustrated by icons 410 in Fig. 4. 

[52] Fig. 5 illustrates another exemplary depiction of an object managed by a computer 
operating system (e.g. a display screen 500 in this example) in which at least some 
information displayed by the operating system is presented in electronic ink format. 
The display screen 500 of Fig. 5 constitutes essentially a combination of the content 
displayed in Figs. 3 and 4. In this illustrated example, when the "view" option 304 is 
selected (e.g., from a file listing screen as described above in conjunction with Fig. 3), 
the top half 502 of the display screen 500 remains as the file listing (with the selected 
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file 504 displayed) and the bottom half of the display screen 500 provides a preview 
pane 506. Various functions can be activated from the display screen 500, as 
illustrated by example icons 508 in Fig. 5. Of course, any suitable or desired 
functions and/or information can be provided, accessible through and/or available on 
the display screen 500. 

[53] Figs. 6A and 6B illustrate an example of how electronic ink data is entered into 
systems and methods for later display in objects managed by the operating system 
according to at least some examples of this invention. In this example, once a 
document or other data has been prepared and/or otherwise downloaded or made 
available on the computer system, the user decides to save this data as a new 
document or file (e.g., on the computer's hard disk drive, on a floppy disk, on a 
network, or in any other suitable or desired computer-readable storage medium). 
Accordingly, the user issues a "save as" or "save" command to the system. This 
prompts display of a "save" box or screen, an example of which is illustrated as 
display box or screen 600 in Fig. 6A (display box or screen 600 also may be referred 
to as a "save dialog box" in this application). 

[54] In this example, the application program calling the save dialog box 600 (e.g., an ink 
input program, a word processing program, a spreadsheet program, an internet 
browser program, etc.) has (at some time) provided data to inform the operating 
system that the user may desire to enter and/or display file names for documents or 
files stored from this application program in an electronic ink format. This may be 
accomplished at any suitable time, for example, when the application program is 
initially downloaded onto the computer, when the save dialog box is called, and/or at 
any other suitable time (e.g., by changing the "properties," "preferences," and/or 
"options" associated with the application program, by sending a "show inking area" 
flag to the operating system, etc.). Accordingly, when the save dialog box 600 
appears in this example, it includes an "inking region" 602 in which the user can enter 
a name for the document or file in electronic ink format (e.g., using a stylus or 
electronic pen associated with a pen-based computing system). In the example 
illustrated in Fig. 6A, the user has written "Doc D" in the inking region 602 using a 
stylus. Then, when the "save" icon 604 is selected (e.g., by tapping the stylus in the 
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icon 604 or in another suitable manner), the document is saved under the handwritten 
file name "Doc D" in "Sub-Directory A" (see sub-directory bar 606) as written by the 
user (the text name (if any) also is saved). Accordingly, the next time the contents of 
this sub-directory 606 are displayed, an icon for the file "Doc D" with a handwritten 
file name will appear in the sub-directory 606, as illustrated by icon 608 in Fig. 6B. 

[55] The electronic ink data corresponding to the handwritten ink title also can be sent 
automatically to a handwriting recognition engine, and the handwriting will then be 
recognized by systems and methods according to at least some examples of this 
invention. Any suitable or desired handwriting recognition engine or software may be 
used without departing from the invention, including, for example, the handwriting 
recognizer included and used in Microsoft Corporation's Windows XP Tablet PC 
Edition™ platform/operating system software. Once recognized, machine-generated 
text corresponding to the recognized handwriting may then appear automatically in 
the save dialog box, for example, in the "text file name" box 610 shown in Fig. 6 A. 
In actuality, systems and methods according to at least some examples of the 
invention will actually save the file using the recognized, machine-generated text 
name, and the electronic ink data obtained via ink input region 602 will be associated 
with the file or document as metadata. The system can then use the machine- 
generated text name for various conventional actions, such as sorting, searching, and 
the like. If the handwriting is incorrectly recognized by the handwriting recognition 
system {e.g., if the wrong words appear in the text file name box 610 after 
recognition), the user may be given an opportunity to correct the recognized text, for 
example, by tapping or clicking in text file name box 610 and making corrections 
using a soft or hard keyboard or mouse, by selecting the correct term or terms from a 
list generated by the handwriting recognition engine, or in any other desired or 
suitable manner, without departing from the invention. Optionally, if desired, the user 
may enter text in text file name box 610 that does not correspond to the handwritten 
information entered in inking region 602 without departing from the invention. For 
example, in the example shown in Fig. 6B, if desired, the handwritten ink name could 
be "Doc D" as shown, but the user could type in a different text file name in box 610 
(such as "Revised Draft II"), using a hard or soft keyboard. As another example, the 
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ink name may include a symbol, drawing, or other graphic element that is not 
immediately recognizable by a handwriting recognizer, but the user could also enter a 
text title in box 610 that the system will use to store and sort the file name. 

[56] In a similar manner, other electronic ink data associated with the document or file 
(such as the author name, comments, keywords, and the like) may be stored as 
metadata associated with the document or file, and the data may be recognized by a 
handwriting recognition engine and stored. If desired, the save dialog box 600 may 
include inking regions for adding ink corresponding to this additional information. 
Alternatively, additional dialog boxes may be called (e.g., from a suitable menu or 
other interface) that will allow entry of this additional information. 

[57] Figs. 7A through 7C illustrate another aspect or feature present in at least some 
examples of this invention. More specifically, these figures illustrate the ability of 
systems and methods according to at least some examples of the invention to change a 
handwritten title or file name associated with a document or file. Fig. 7A illustrates 
an exemplary display screen 700 managed by an operating system as it might appear 
after a "list files" or "search" operation has been performed by the operating system 
and/or by an application program present on or accessible through the operating 
system. In addition, as illustrated in Fig. 7A, the user has selected a file having an 
electronic ink or handwritten file name (the file "My Resume" 702 in this example). 
For example, by selecting file 702 using a "press-and-hold" action with the stylus 
(i.e., touching the stylus down on the file name 702 and holding it steady for a 
predetermined time period, which is akin to a right mouse button click with a 
conventional mouse), a menu will appear like the menu 306 shown in Fig. 3. Then, 
by selecting the "change name," "edit profile," or other suitable or desired option 
from menu 306 (e.g. , by tapping or touching the stylus on the selected option in menu 
306), a user interface or dialog box will appear that enables the user to perform the 
name change operation. In the illustrated example of Fig. 7A, activation of the user 
interface in this manner will cause a file name change interface box 704 to appear. 
When it initially appears, the file name change interface box 704 will include the 
original ink and text file names (in areas 706 and 708, respectively). If desired, the 
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user can correct handwriting recognition errors by tapping the stylus in box 708 and 
making the necessary corrections (e.g., using an associated soft or hard keyboard). 



[58] If the user desires to change the handwritten title, he or she can first erase the existing 
title, e.g., by tapping on the erase button 710 using the stylus (as indicated in Fig. 7 A 
by arrow 712). This action will erase the handwritten title from box 706 
(alternatively, it may change the stylus to act as an eraser, and the user then can 
selectively erase some or all of the existing title). Optionally, if desired, this action 
also can erase the machine-generated tide from text file name box 708, or this action 
can occur later, for example, after a new title is handwritten. Once erased, the user 
can write a new title for the document in box 706. For example, as illustrated in Fig. 
7B, after erasing the original title ("My Resume"), the user has written the new title 
"New Resume" in ink input box 706. Completion of the title (e.g., after a 
predetermined time period or activation of an icon on the interface) prompts the 
handwriting recognition engine to recognize the new title, and the recognized title 
then appears in box 708. If necessary or desired, the user can change the machine- 
generated title stored in association with the document, e.g., to correct recognition 
errors, to add a different machine-generated title, etc. Once the user is satisfied with 
the new handwritten and/or recognized title(s), he or she can tap on the "OK" button 
714 using the stylus (represented in Fig. 7B by arrow 712), which prompts the system 
to save the new title. The name change interface box 704 will then disappear, and the 
title will changed to the new title 720 in display 700, as illustrated in Fig. 7C. 

[59] Figs. 8A through 8C illustrate an exemplary interface that enables the addition of an 
ink name to a file that previously had only a machine-generated text name. As shown 
in Figure 8A, after a "list files," search, or other suitable operation, a display screen 
800 appears listing several files saved on or otherwise available over the computer 
system. In this instance, the user decides to add an electronic ink file name to the 
document 802 entitled "Status Report." This may be accomplished, for example, by 
selecting document 802 with a stylus using a "press-and-hold" action (represented by 
arrow 804), which generates an available action menu (akin to menu 306 discussed 
above), and then selecting a proper item from that menu that enables addition of an 
ink name (e.g., an "add ink name" icon, a "save" or "save as" operation, an "edit 
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profile" operation, etc.) The above action causes an add ink name interface box 806 
to appear, as illustrated in Fig. 8A. As illustrated, when the add ink name interface 
box 806 appears in this example, there is no handwritten name in the ink area 808 
(because no handwritten name existed that was associated with document 802), but 
the machine-generated name "Status Report" appears in the text file name box 810. 

[60] Then, as illustrated in Fig. 8B, the user enters an ink title into the inking area 808 
using a stylus. While in the present example, the user wrote the same title as the 
previously present machine-generated title, this is not a requirement. Rather, any ink 
title may be entered without departing from the invention. Also, systems and methods 
according to at least some examples of the invention may be designed to recognize the 
new handwritten name and (if necessary) to change the machine-generated title in text 
file name box 810 to match the new recognized name. Alternatively, if desired, the 
original machine-generated title in box 810 may remain unchanged, optionally until 
the user prompts the system to recognize the new handwritten title. Once the user is 
satisfied with the handwritten and machine-generated titles, he or she can tap the 
stylus on the "OK" button 812 (as represented by arrow 814), which then replaces the 
machine-generated title 802 with the handwritten title 816 in the interface screen 800, 
as illustrated in Fig. SC. 

[61] Of course, many variations and modifications in the specific displays, the actions 
activating the various displays, and the other actions described above in conjunction 
with the save, name change, and ink name addition operations of Figs. 6A through 8C 
may be used without departing from the invention. Specifically, any suitable 
displays, interface boxes, and processes that allow saving, changing, adding, and/or 
otherwise manipulating handwritten and/or machine-generated names associated with 
a file or document name and/or other information can be used without departing from 
this invention. 

[62] Fig. 9 illustrates additional examples of objects managed by an operating system that 
may include file or document names and/or other information associated with a file or 
document in handwritten electronic ink. For example, Fig. 9 illustrates a computer 
screen 900 on which an operating system is operating and an application program 
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(called "Word Processor" in the illustrated example, although operation of any type of 
application program is possible) is running on the computer. As illustrated, the word 
processing program of this example may accept, display, manipulate, and/or 
otherwise process electronic ink data as well as machine-generated text. Of course, 
the application program could accept, display, manipulate, and/or otherwise process 
any desired or suitable other types of data, including, for example, graphics, tables, 
drawings, spreadsheet data, etc. 

[63] Notably, in the title bar 902 on the display screen 900, the operating system of the 
computer displays both the application program name 904 ("Word Processor" in this 
example) and the specific file name 906 that is open on the display ("Revised draft" in 
this example). Because this specific document had been stored with an electronic ink 
file name, the operating system displays the document title 906 in the title bar 902 in 
electronic ink format. 

[64] Of course, the operating system and/or application program may dictate inclusion of 
any other suitable or desired ink information in the title bar 902 without departing 
from the invention. For example, a digital signature-capturing program may desire to 
show the last captured signature in the title bar 902. As still additional examples, the 
name of the author of the open document in the application program, its creation date, 
its last edit or save date, or the like may appear in electronic ink format in the title bar 
902, if desired. Many combinations and variations in the displayed ink information 
are possible without departing from the invention. 

[65] Fig. 9 illustrates still additional areas in which document titles or other information 
might appear in electronic ink format. As illustrated, the application bar 910 at the 
bottom of display screen 900 indicates that several additional documents have been 
opened by the user on the system. The titles in the icons for two these documents, 
namely icon 912 for "Doc D" and icon 914 for "Chart A," appear in electronic ink 
form because electronic ink formatted document titles have been saved for these 
documents. 

[66] In essence, systems and methods according to at least some examples of this invention 
will allow electronic ink titles and/or other electronic ink information to be associated 
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with specific electronic documents or files and stored (e.g., as metadata associated 
with the document or file). Once stored, the electronic ink title and/or other 
information can be accessed, used, and rendered by the operating system wherever 
and whenever it appears on the system. Of course, if desired, application programs 
and users can be given various options that dictate how the file names will appear 
when rendered by the operating system. For example, application programs and users 
can be given the ability to dictate whether ink titles will be used for a specific 
program and/or document, the circumstances under which the ink title will be used in 
preference to a machine-generated title, and the like. 

[67] Fig. 10 illustrates one optional way of displaying ink titles and other information 
within fields having restricted lengths and the like. When titles or other information 
are displayed as machine-generated text, if the width of a title or the other typewritten 
information exceeds the width allotted in the field, the name (or other information) 
typically will be truncated in some manner. For example, in some instances, the name 
or other information will be truncated at a certain width and the remainder will be 
replaced with an ellipsis (e.g., the three dots "...") to indicate that additional 
information is present. As another alternative, the name or other information may 
simply be truncated. 

[68] Fig. 10 illustrates an aesthetically pleasing way of truncating a handwritten file name 
(or other handwritten information) when its length exceeds the overall available field 
width. Specifically, in the illustrated example, the ink appears in a constant color 
over the majority of the overall field width. However, at some distance before the end 
of the field (distance "Dl" in Fig. 10), the ink will become somewhat lighter. 
Optionally, the ink may become lighter still as it gets closer to the end of the field 
width (distances D2 and D3 in Fig. 10) until it finally fades out and is not visible at 
the very end of the available field width. Alternatively, rather than lightening the ink 
in one or more discrete steps, as shown in Fig. 10, the ink may become constantly 
lighter over some portion of its length (e.g., over distance Dl) without departing from 
the invention. Of course, any desired or suitable truncation method or no truncation 
method may be used without departing from the invention. 
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[69] In at least some examples of the invention, the electronic ink used to provide the 
document title or file name (or other information) will be resized (if necessary) to fit 
into a predetermined field size for this information. For example, when a user enters 
electronic ink into an inking area to provide a document title or file name (e.g., in 
inking areas 602, 706, and 808 discussed above), the resulting ink title (or other 
information) will have an overall height, an overall width, and a bounding box size. 
Then, in at least some examples of the invention, when displayed in a list or other area 
of the interface by the operating system, the ink representing the title (or other 
information) may be uniformly resized such that its overall height will fit within the 
allotted height of the display field. Then, if necessary, the ink's overall width may be 
truncated to fit in the allotted width of the display field (e.g., as described above in 
conjunction with Fig. 10). As another alternative, the width of the ink title or other 
information field could be preset, the ink representing the title (or other information) 
may be uniformly resized such that its overall width will fit within the allotted width 
of the display field, and then the height of the ink could be truncated or cropped (from 
the top or bottom or both) to fit within the predetermined height (e.g., including use of 
the fading method described above in conjunction with Fig. 10, except in a vertical 
manner rather than a horizontal manner). Such systems and methods may be 
particularly suitable for use with languages written and/or read in a vertical manner. 
Other suitable ways of determining an appropriate size for the ink title or other 
information in a given field may be used without departing from the invention. 

[70] Ink titles or other information also may be stored and/or rendered in any color without 
departing from the invention. For example, the ink color used for the title or other 
information may correspond to the color originally used by the user in writing the 
information (and the background color may automatically correspond to the 
background color used by the user or to a default, contrasting background). As 
another example, all ink titles or other information may be stored in a predetermined, 
default color selected by the operating system, e.g., as monochrome ink without a 
stored background color or foreground color (in this manner, because the operating 
system selects the colors of the ink and background, there is no need to worry that a 
user's specific ink color choices will conflict with or inadequately contrast from the 
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system background color in use and/or that the user's color selections will contrast 
with another user's color selections (e.g., if the document or file is sent to or called up 
by another user)). For example, in this arrangement, the ink color may correspond to 
the color of the machine-generated text that it is replacing (i.e., if the machine- 
generated text would have been white on a black background, then the ink title or 
other information also will be white on black). As still another alternative, the user 
may be given choices for the ink color of all titles, and the system could then select an 
appropriately contrasting background color. The ink title colors also may change, in 
at least some examples of the invention, depending on user choices, the default 
settings of the operating system on which it is being rendered, etc. Any system or 
method for selecting the ink and background colors for the titles may be used without 
departing from this invention. 

[71] Fig. 11 illustrates example architecture 1100 useful in displaying ink titles or other 
information by operating systems in accordance with at least some examples of the 
invention. Before an ink title or other information can be displayed by the operating 
system, the electronic ink corresponding to the desired information must be entered 
into the system, as described above. As is known in the art (for example, in systems 
and methods for accepting electronic ink in pen-based computing systems operating 
Microsoft Corporation's Windows XP Tablet PC Edition™ software operating 
system), the ink for the file name or other information may be stored in an "ink 
serialized format" or "ISF." As mentioned above, the electronic ink title or other 
information also may be stored as a metadata property associated with a specific file 
or document. Of course, any other suitable or desired format(s) for storing electronic 
ink data may be used without departing from the invention. 

[72] As shown in Fig. 11, when new files or documents are stored on systems and in 
methods according to at least some examples of the invention ("File 1" and "File 2" in 
the illustrated example), new metadata properties 1 102 and 1 104 are defined for these 
files (an "Ink Title ISF" property) that will contain a set of ink strokes corresponding 
to the title (or other information) in ink serialized format. Additionally, in at least 
some examples, a parallel property 1106 and 1108 in an enhanced metafile format 
(e.g., an "Ink Title EMF" property) also may be defined and associated with the 
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document for use on systems that cannot read or write ink from ink serialized format 
data (enhanced metafile format or "EMF" is a standard drawing format known in the 
art). These properties optionally may be promoted into a data performance cache 
1110 (such as "WinFS"), which may be used to accelerate retrieval of the data 
corresponding to the ink titles (or other information). 

[73] When called upon to render an ink title, a piece of code (e.g., an "Ink Extractor" code 
1112) will convert the ISF or EMF data corresponding to the title or other information 
(either from the performance cache 1110 or directly from the properties stored in or 
associated with File 1 or File 2) to bitmaps of specified dimensions (as generally 
described above). Then, when a file listing is being prepared, a File Listing Engine 
1 1 14 (such as a "DefView" object) will query files to be included in the listing for ink 
titles as it loads a folder corresponding to the desired list. ("DefView" is a 
Windows® operating system component that extracts information from a file list (the 
Windows® operating system is commercially available from Microsoft Corporation 
of Redmond, Washington)). When files having ink titles are found, the File Listing 
Engine 1114 will build an Image List with the ink titles and pass this information to a 
List Display component 1116 (such as "List View," a conventional Windows® 
operating system component). The List Display component 1116 will then display 
the ink titles at the appropriate location in place of the text file names in the list being 
displayed. 

[74] Of course, many variations in the specific architecture for providing the electronic ink 
file names and other information in the objects managed by the operating system may 
be used without departing from the invention. For example, the performance cache 
1110 may be omitted if desired. The system illustrated in Fig. 11 is merely one 
example of a possible architecture. 

[75] Finally, the present invention also relates to computer-readable media including 
computer-executable instructions stored thereon for performing various methods 
and/or for use in various systems, including the systems and methods described 
above. The computer-readable media may constitute computer-executable 
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instructions stored on the various specific examples of computer-readable media 
described above. 



V. CONCLUSION 

[76] Various examples of the present invention have been described above, and it will be 
understood by those of ordinary skill that the present invention includes within its 
scope all combinations and subcombinations of these examples. Additionally, those 
skilled in the art will recognize that the above examples simply exemplify various 
aspects of the invention. Various changes and modifications may be made without 
departing from the spirit and scope of the invention, as defined in the appended 
claims. 
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